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MEMORANDUM FOR Mr. Richard Ober, National Security Council 
2pX1A Intelligence Community Staff. 


SUBIECT: Status of IC Staft Study of Reporting of Uncertainty In Intelligence 


Reference: Minutes of NSGIC/WG mecting dated 2 July 1975 


G ISD Declassification/Release Instructions on File 
The NSCIC/WG originally sought information on the reporting of 
- uncertainty data in current national intelligence products because serious 
questions exist as to the reliability and meaning of many of the fig@Pes 
used in national intelligence estimates. The IC Staff has so far bri@fed 
the .NSCIC/WG on the work it is doing to (a) study what the commurniey is 
doing to improve part of its uncertainty data, or (b) conduct Taser ey Ss 
into better methods of analyzing uncertainty. ; = me 
° 
Mr, Ellewor th stressed in the meeting of the NSCIC/WG on Bsuly z 
i. that the current IG Staff paper on expressing uncertainties in technicg) 
| ~~ judgements would answer only a small part of the requirement for pYdgress 


in this area. 


This comment needs to he followed up. Iam certain that you both 
apree that the lack of proper uncerlainty data represents a critical problem 
in current national intelligence production. In far too many cases, consumers 

have no way of knowing the reliability of the data they are given. 


Further, the community seems to have failed to really address the 
problem in rigorous analytic detail in many areas of key importance to SALT 
and MBFR, Accordingly, when it does provide uncertainty data, it i 
difficult to understand what level of analytic effort went into the figures 


or to place high confidence in the result. _ ow 2 
: 28 > 

Soviet strategic yields, CEPs, and silo hardness are critica? ok 
examples of such problem areas, So are Warsaw Pact military manning, <0 
equipment strength, and readiness data. i 
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Accordingly, I think it would be useful if at the next meeting of 
the -NSCIC/WG; or in-a separate staff paper,- the IC Staff.could report 
OM Prepress HuL! | 


-- measuring the oxtent to which explicit quantitative state- 
ments of uncertainty are provided for all figures shown in the NIifes, SNIEs, 
and NIAMs, 


es improving uncertainty data on force strengths and force 
readiness as well as on technical data. — me 


-- providing explicit summary statements of the major limitations 
and uncertainties in the intelligence provided in NIEs, SNIEs, and "NIAMS. 
: «~- correcting the grave problems which have existed in past 
amewrihintd estan dec besa da? he wemand Date Ariiamiiliativelest ie 
communiiy witht urewrtality-data, and (b) the: resistance of-untraincd 
personne! to replace loose adjectival estimates: with modern analytic 


tectinaques. 


fF Anthony H. Cordesman 


i Chief, Product Evaluation. Division. 
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